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IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 

Applicant: R. KAMINSKY, et al. 

Serial Number: Not Yet Assigned 

Filed: 1 8 August 1 998 as PCT/IL98/00393 

For: INSPECTION OF PRINTED CIRCUIT BOARDS USING COLOR 

Art Unit: Not Yet Assigned 

Examiner: Not Yet Assigned 

Honorable Commissioner of Patents and Trademarks 
Washington DC 20231 

PRELIMINARY AMENDMENT 

Sir: 

Further to the concurrent filing of the U.S. national stage of PCT/IL98/00393, kindly 
amend the application as follows prior to examination: 

IN THE DISCLOSURE 
Kindly add, on page 1, after the title: 

-RELATED APPLICATION 
The present application is a U.S. national stage application of PCT/IL9 8/003 93, filed 18 
August 1998.-- 

IN THE CLAIMS 

The following amendments are based on the claimed attached to the IPER submitted 
together with the application. 

Claim 3, line 1, delete "or claim 2". 

Claim 4, line 1, delete "or claim 2". 

Claim 6, line 1, delete "or claim 5". 

Claim 8, line 1, delete "or claim 7". 

Claim 9, line 1, change "any of claims 6-8" to -claim 6-. 

Claim 11. line 1, delete "or claim 10". 

Claim 12, line 1, change "any of claims 6-11" to -claim 6~. 

Claim 13, line 1, change "any of claims 6-12" to -claim 6-. 

Claim 17, line 1, change "any of claims 2-16" to -claim 2-. 

Claim 18, line 1, change "any of claims 4, 5 or 12" to -claim 4-. 

Claim 21, line 1, delete "or claim 20". 



1 



139/02059 A01 

Claim 22, line 1 ? change "any of claims 19-21" to -claim 19—. 



Kindly add the following new claim: 
-23. A method according to claim 12 and comprising: 

determining a color gamut characteristic of an oxide; and 

comparing the color values of a pixel to the determined gamut to determine if the pixel is 
an oxide. — 



REMARKS 

The present application is a U.S. national application of PCT/IL98/0Q393. Applicant 
respectfully requests that the claims attached to the enclosed International Preliminary 
Examination Report be used as the basis for the present amendments. 

The present application, after amendment, contains claims 1-23. The IPER claims in the 
application have been amended to place them in proper form for examination in the US. New 
claim 23 has been added to better define the invention as described in the application as originally 
filed. 

An examination on the merits is respectfully awaited. 



Respectfully submitted, 
R. KAMINSKY, et al. 



Paul FENSTER 
Registration No. 33,877 



February 7, 2001 
William H. Dippert, Esq. 
Cowan, Liebowitz and Latman, P.C. 
1 133 Avenue of the Americas 
New York, NY 10036-6799 

Tel: (212)790-9200 
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INSPECTION OF PRINTED CIRCUIT BOARDS USING^OLOR 

^ FEFOTliEINVENTION 
The present invention is related to the field of inspection of patterned surfaces, such as 
printed circuit boards and in particular to the identification of certain types of conditions, such 
5 as conductor oxidation, using color. 

BACKGROUND OF THE INVENTION 
One widely used method for inspection of "bare" printed circuit boards having 
metalized portions and, unmetalized, laminate portions is to: 

(a) illuminate the board with light which appears to come from a wide range of angular 
10 directions; 

(b) image the illuminated portion; 

(c) define the metalized portions from the image of the board; and 

(d) determine defects in metalization on the board by one or more of comparison of the 
image with a standard image and analysis of the image with a set of standards or rules to 

15 determine if it meets the rules. 

Among prior art publications which describe such methods are US Patents 4,758,888; 
5,619,429; 5,774,572; and 5,774,573, the disclosures of which are incorporated herein by 
reference. 

One of the problems in making this comparison is the determination of edges between 
20 areas covered by conductors on the board and areas without conductors. A number of 
publications, including, for example, US Patent 5,524,152, the disclosure of which is 
incorporated herein by reference, have suggested the use of color to improve this 
determination. In general, these methods image the board utilizing a color at which the 
contrast between the conductors and areas from which the conductors have been removed is 
25 maximized. This may be achieved by illuminating the surface with light which maximizes 
contrast or by filtering the light which is reflected prior to forming the image. In particular, the 
above referenced US Patent 5,524,152 generates one or more different images each based on a 
different filter to emphasize different materials, such as gold copper, etc. 

US Patent 5,483,603, the disclosure of which is incorporated by reference, defines a 
30 region in RGB space that characterizes a conductor and a region in RGB space that 
characterizes a laminate. Pixels are classified as conductors or laminate depending on which 
regions contains their RGB values. 
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While ideally, the board should consist of only two types of areas, namely metal and 
bare substrate, unfortunately the metalization on a board is sometimes oxidized. Furthermore, 
several types of oxidation and various levels of severity of oxidation exist, making it difficult 
to determine criteria for reliably identifying oxidation. 
5 Since oxidation is a widespread phenomena in printed circuit board manufacture, 

especially when the boards have been in storage for a considerable period of time and/or have 
been stored under less than ideal conditions, it would be useful to be able to reliably determine 
areas of oxidation on printed circuit boards. Such identification could be useful, for example, 
in avoiding classification of such areas as containing defects. 
10 SUMMARY OF THE INVENTION 

In a broad aspect of the invention, the present invention determines the presence of 
oxide on a conductor on a printed circuit board from an image of the printed circuit board. 

In accordance with some preferred embodiments of the invention, color characteristics 
of light reflected from the surface of a printed circuit board are used to determine if the area is 
15 an oxidized conductor. The method of the present invention may be used in any imaging 
system in which images at multiple colors are acquired. 

According to one broad aspect of the present invention, the presence of an oxide (or 
another definable aspect of the pixel) is determined by comparing the color characteristics of a 
suspect pixel with the color characteristics of either the metalization or laminate portions, 
20 preferably, the metal portions. 

According to a second broad aspect of the present invention, the presence of an oxide 
(or another definable aspect of the image) is determined by comparing the color components of 
a suspect pixel utilizing a normalizing scale based on the color characteristics of either the 
metalization or laminate portions, preferably, the metal portions. 
25 According to a third broad aspect of the present invention, the presence of an oxide is 

determined by first finding a region of the color space which is characteristic of oxide and then 
determining if the color values of a pixel is within this region. 

In accordance with one aspect of some preferred embodiments of the invention, the 
determination of an oxide is made without directly excluding the presence of a laminate. In 
30 addition, in some preferred embodiments of the invention, only "interior" pixels (that is pixels 
not near an edge) are classified as oxide. 

In a preferred embodiment of the invention each of the color scales for RGB is first 
normalized between a low light level and the reflection from fine (unoxidized) copper. 
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Preferably, the "dark level" is set at a few gray levels above zero and the "copper level" is set 
at a few gray levels below the maximum gray level. For example, the darkest portion of the 
image may be set at 10 gray levels and the copper (brightest) gray level set at 230 gray levels 
for 8 bit quantification of light leveL 
5 In a preferred embodiment of the invention, a pixel having a red intensity below a red 

threshold level is determined not to be an oxide. For other pixels, for which not all of the 
colors have intensities within a range indicative of copper, preferably the red level is compared 
to the level of other colors. If the red (normalized) level is greater than both the green 
(normalized) and blue (normalized) levels, the pixel is identified as brown oxide, the most 
10 prevalent type. Different combinations of characteristics may be used for determining the 
presence of other oxide types. 

In other preferred embodiments of the invention, a comparison is made with brightness 
levels of the laminate. 

Similar comparisons are useful for determining other types of oxidation and/or 
15 laminate problems and may be useful for the determination of the presence of other materials 
such as gold, tin-lead, or double treated copper conductors, cyanide ester, polymid or teflon 
laminate, photoresist residues or dust. 

There is thus provided, in accordance with a preferred embodiment of the invention, a 
method of analysis of a printed circuit board comprising: 
20 generating an image of the printed circuit board; and 

determining the presence of an oxide from an analysis of the image. 

Preferably, determination of the presence of an oxide is made without determining 
whether the pixel is a laminate pixel. 

Preferably, generating an image comprises generating a pixelated image having 
25 brightness values for each pixel and determining the presence of the of an oxide comprises 
determining the presence of the oxide responsive to the brightness values. 

Preferably, generating an image comprises generating a plurality of images each at a 
different color and having brightness values for each pixel in each image and determining the 
presence of an oxide includes making the determination based on an analysis of the pixel 
30 values in at least two of the images. Preferably, the plurality of images comprises a red, a 
green and a blue image. 

Preferably, determination of the presence of an oxide includes eliminating pixels from 
consideration based on a brightness value for a single color. Preferably the color is red and 
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pixels having a red brightness level below a given value are eliminated from consideration as 
being an oxide. Preferably, the color is red and wherein pixels having a red value above a 
given value are eliminated from consideration as being an oxide. 

In a preferred embodiment of the invention, determination of the presence of an oxide 
5 includes eliminating pixels from consideration based on a comparison between the brightness 
level of two colors. Preferably, the two colors are red and green and wherein the pixel is 
eliminated if its red brightness value compared to that of copper is less than its green 
brightness value compared to copper. Preferably, the two colors are red and blue and wherein 
the pixel is eliminated if its red brightness value compared to that of copper is less than its blue 
10 brightness value compared to copper. 

In a preferred embodiment of the invention, determination of the presence of an oxide 
includes eliminating pixels from consideration based on an analysis of the brightness levels of 
three colors. 

In a preferred embodiment of the invention, determination of the presence of an oxide 
15 includes eliminating pixels from consideration based on a comparison between the brightness 
level of three colors with brightness levels for copper. Preferably, a pixel is eliminated from 
consideration as an oxide when its color brightness values have a Mahalanobis distance greater 
than a given value from the mean values of the brightness values for copper. Preferably, the 
given value for the Mahalanobis distance is between 4 and 8, more preferably, about 6. 
20 In a preferred embodiment of the invention, the determination of the presence of an 

oxide is made based on a relationship between the brightness values of the image and 
brightness values characteristic of copper. 
Preferably, the method includes: 

determining a color gamut characteristic of the oxide; and 
25 comparing the color values of a pixel to the determined gamut of values to determine if 

the pixel is an oxide. 

There is further provided, in accordance with a preferred embodiment of the invention, 
a method of multi-color image processing, comprising: 

generating a plurality of images of an object, said images being acquired at different 
30 wavelength ranges; 

determining gradient values in the image; and 

analyzing the multi-color images to determine characteristics of the object, 
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wherein regions of the image at or near high gradients are analyzed differently from 
other regions of the image. 

In preferred embodiments of the invention, the regions of high gradient are transition 
regions, such as edge regions and in particular edges between conductors and laminate. 
5 In preferred embodiments of the invention, the regions of high gradient are excluded 

from analysis. 

In preferred embodiments of the invention, the object is a printed circuit board. 
The invention will be more clearly understood from the following description of non- 
limiting preferred embodiments thereof. 
10 DESCRIPTION OF PREFERRED EMBODIMENTS OF THE INVENTION 

In a preferred embodiment of the invention, a printed circuit board (PCB) is 
illuminated by multi -wavelength light and imaged in a plurality of colors, for example in 
RGB. While the methods of the invention are applicable to any imaging system in which 
images at multiple colors are acquired, in an especially preferred embodiment of the invention, 
15 the PCB is illuminated by and the images are acquired by the apparatus described in PCT 
patent application PCT/IL98/00285, filed June 15, 1998, the disclosure of which is 
incorporated by reference. 

In a preferred embodiment of the invention in which it is desired to determine the 
presence of brown oxide, three color images, namely R, G and B images are generated. 
20 Optionally, as disclosed in PCT/IL98/00285, filters are used to reduce any cross-over of colors 
between the images, such that each image represents reflections in a different wavelength. 
Alternatively, white light is used for illumination and standard light division (and associated 
overlapping sensitivity) is used. 

As a first preferred step in the determination, a set-up is performed to calibrate the 
25 system. This calibration is preferably performed utilizing a standard manufactured, bare, PCB, 
preferably fee of oxide. Preferably, an operator chooses a portion of the board which has a mix 
of interior copper pixels, edge pixels and some laminate pixels. 

First, the brightness of the illumination and the camera and A/D parameters are 
adjusted such that the gray level for each of the colors RGB for subsequently acquired images 
30 will have a dark level of about 10 and a value for a copper pixel of about 230 for 8 bit 
quantification of light level. 

The next step is to define a "low sure" threshold from an analysis of transition pixels 
(pixels on or near transitions between conductor and laminate). This calculation is in 

5 



WO 00/11454 



PCT/IL98/00393 



accordance with the calculation detailed in Fig. 15 from US Patent 5,774,573 (Caspi et al.) 
except that only the gray level value is accumulated, not ordered pairs of (gray level, gray level 
difference). The object of this threshold is to define pixels whose red level is so low that they 
cannot be an oxide. Other thresholds and methods of defining such thresholds may be used 
5 instead of the "low-sure" threshold. 

The next step in the set-up is to produce a 3-D histogram of the colors of all the interior 
copper pixels in the region of limited size. It has been found that a region of 700 by 700 pixels 
gives adequate statistics. For the 3-D histogram, the mean is computed. The mean may also be 
computed from the three separate color distributions. 
10 Preferably, a covariance matrix is formed from the values. This matrix is: 

y (R t -R) 2 y (R f -~R)*(Gj -G) y (Ri-R)*(Bj-B) 

y (Ri -R)*(Gj -G) y (Gj -G) 2 (Gj-ty.jBj-B) 

^ (N-l) _ ^ (N-l) ^ (AT-1) 

y (Ri-R)^(B t -B) y (G t -G).(B f -B) y jBj-B) 2 

^ (iV-1) ^ (A^-l) ^ (N-l) 

This matrix is inverted to form an inverted covariance matrix. This inverted matrix is 
used to determine if a pixel is an oxide. 

In a preferred embodiment of the invention, the following rules are applied to image 
15 pixels in a PC board under test to determine if a pixel is oxidized. 

1) if the pixel is at a strong gradient (for example, it is an edge pixel), it is not checked 
and is not marked as an oxide; 

2) if is Mahalanobis distance (as defined below) from the mean value of copper pixels 
is less than some given value, it is not an oxide; This value may vary between about 4 and 8, 

20 with 6 being a preferred value; 

3) if the red pixel value is less than the low-sure threshold for red, it is not classified as 
an oxide (it is definitely laminate); 

4) optionally, if red is less than green for a pixel, it is not classified as an oxide; 

5) optionally, if red is less than blue for a pixel, it is not classified as an oxide; and 

25 6) optionally, if the red value is greater than some high value (for example, 220) it is 

not classified as an oxide. 

The Mahalanobis distance for a pixel is determined by forming a vector and pre- 
multiplying the inverted covariance matrix by the vector and then post-multiplying the product 
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by the transpose of the vector. The scalar that results from this "modified inner product" of the 
vector is the square of the Mahalanobis distance . 

A preferred algorithm for determining if a pixel is at a strong gradient (i.e., it is 
considered to be an edge pixel and thus not subject to the above analysis) is: 
5 Let I[x,y] be the gray level value of the red image at location (x,y). 

To calculate if the pixel at location (x ? y) is an edge pixel: 

Let s - ceoCI^.yUtx-l^lJt^y],!^!^],!^^]) 
10 +ceo(I[x J y-23J[x ? y-l] ? I[x,yy[x ; y-M] 5 I[x 5 y-H2]) 

+ ced(I[x-2,y-2] > I[x-l ) y-l] 3 I[x,y],I[x+l ? y+l]J[x+2 ? y+2]) 
+ ced(I[x-2 5 y-f2]J[x-l ? y+l] J I[x,yj ? I[x-M,y.l] ? I[x+2,y.2]) 

where the functions ceoO and ced() are defined by the computer program 
1 5 fragment below. 

Then if s >= 12, the pixel at (x,y) is an edge pixel. 

> typedef unsigned char uchar; 
20 > 

> static int sst[4][4] - { {1, 2, 2, 2} s {2,-1, 2, 2}, 

> {2,2,0 ? 0} ? {2,2,0,0}}; 
> 

> int f(int d) 
25 > { 

> return (abs(d) < 4 ? 0 : (abs(d) < 8 ? 1 : 

> (abs(d) < 12 ? 2 : (abs(d) < 16 ? 3 : 

> (abs(d) < 24 ? 4 : (abs(d) < 36 ? 5 : 

> (abs(d) < 128 ? 6 : 7))))))) * (d < 0 ? -1 : 1); 

30 >} 
> 

> void ht(float dl, float d2, int *s, float *v) 
>{ 

> *v = 0.375*dl +CU25*d2; 
35 > 

> if(fabs(*v)<0.3) 

> *s = (ftbs(dl)<0.1) ?2 :3 ; 

> else { 

> * s « (* v >0) ? 0 : 1 ; 
40 > } 

> *v = fabs(*v); 

>} 

> 

> int ct(int d[4]) 
45 > { 

> ints, sl,s2; 

> float vl,v2, ret; 

> int t, v; 
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> 

> ht(-d[l],-d[0],&sl,&vl); 

> ht(d[2], d[3], &s2, &v2); 
> 

5 > ret = (vl+v2+l)/2 ; 

> if(ret>3) 

> ret = 3; 

> if (ret < -3) 

> ret = -3; 
10 > v = (int) ret ; 

> 

> s-sst[sl][s2]; 

> 

> if(s = 2){ 

15 > if (fabs(vl) > 2 || fabs(v2) > 2) 

> t = 4; 

> else 

> t = 0; 

> } 
20 > else 

> t-0; 

> 

> return t; 

>} 
25 > 

> int ceo(uchar gO, uchar gl ? uchar g2, uchar g3, uchar g4) 

>{ 

> intd[4]; 

> 

30 > d[0] = f(gl-gO); 

> d[l] = f(g2-gl); 

> d[2J = f(g3-g2); 

> d[3] = f(g4-g3); 

> return ct(d); 
35 >} 

> 

> int ced(uchar gO, uchar gl, uchar g2, uchar g3 ? uchar g4) 
>{ 

> int d[4]; 

40 > 

> d[0] = f((gl-g0)/sqrt(2)); 

> d[l] = f((g2-gl)/sqrt(2)); 

> d[2]-f((g3-g2)/sqrt(2)); 

> d[3] = f((g4-g3)/sqrt(2)); 
45 > return ct(d); 

>} 

In an alternate preferred embodiment of the invention, a multi-dimensional region of 

color space characteristic of an oxide, whose presence is to be tested, is determined. Such a 

determination may be made by imaging a number of samples of oxide and determining the 
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range, in color space, of the images. During testing, the color values of teat pixels are 
compared to the values in the determined region. If the values are within the region, the pixel 
is labeled as an oxide. Optionally, edge and other high gradient pixels are excluded from 
classification as oxides. While such color maps have been used, in the past, to determine metal 
5 and laminate, they have not been used to determine the presence of oxide and have not been 
used in conjunction with gradient information. Furthermore, this method is easily adapted to 
testing for other types of oxide and even to the presence of dust on conductors. 

One preferred use of the information determined by the above described method is in 
avoiding the classification oxide or dust pixels as faults in a printed circuit board. Since these 

10 pixels generally have a brightness between that of copper and laminate, they may sometimes 
be classified as laminate by normal threshold programs. Edge finding programs may also have 
difficulty in determining edges near oxide. Thus, when the above method determines that a 
pixel is oxide, it is, for the purposes of a fault determination program, defined as a metal pixel. 
The present invention has been described in conjunction with preferred, non-limiting, 

15 embodiments thereof. It should be understood that variations on these embodiments, within the 
scope of the invention, as defined by the following claims, will occur to persons of skill in the 
art. In the following claims, where the words "comprising," comprises," including" or 
"includes" are used these words mean that the apparatus or method includes the following 
structure or steps, but may (but need not) include other structure or steps. 
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CLAIMS 

1 . A method of analysis of a printed circuit board comprising; 
generating an image of the printed circuit board; and 

5 determining the presence of an oxide from an analysis of the image. 

2. A method according to claim 1 wherein determination of the presence of an oxide at a 
particular pixel of the image is made without determining whether the pixel is a laminate pixel. 

10 3, A method according to claim 1 or claim 2 wherein generating an image comprises 
generating a pixelated image having brightness values for each pixel and wherein deteimining 
the presence of the of an oxide comprises determining the presence of the oxide responsive to 
the brightness values. 

15 4. A method according to claim 1 or claim 2 wherein generating an image comprises 
generating a plurality of images each at a different color and having brightness values for each 
pixel in each image and wherein determining the presence of an oxide includes making the 
determination based on an analysis of the pixel values in at least two of the images. 

20 5. A method according to claim 4 wherein the plurality of images comprises a red, a green 
and a blue image. 

6. A method according to claim 4 or claim 5 wherein determination of the presence of an 
oxide includes eliminating pixels from consideration based on a brightness value for a single 

25 color. 

7. A method according to claim 6 wherein the color is red and wherein pixels having a red 
brightness level below a lower given value are eliminated from consideration as being an 
oxide. 

30 

8. A method according to claim 6 or claim 7 wherein the color is red and wherein pixels 
having a red value above an upper given value are eliminated from consideration as being an 
oxide. 
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9. A method according to any of claims 6-8 wherein determination of the presence of an 
oxide includes eliminating pixels from consideration based on a comparison between the 
brightness level of two colors. 

5 

10. A method according to claim 9 wherein the two colors are red and green and wherein 
the pixel is eliminated if its red brightness value compared to that of copper is less than its 
green brightness value compared to copper. 

10 11. A method according to claim 9 or claim 10 wherein the two colors are red and blue and 
wherein the pixel is eliminated if its red brightness value compared to that of copper is less 
than its blue brightness value compared to copper. 

12. A method according to any of claims 6-11 wherein determination of the presence of an 
15 oxide includes eliminating pixels from consideration based on an analysis of the brightness 

levels of three colors. 

13. A method according to any of claims 6-12 wherein deteimination of the presence of an 
oxide includes eliminating pixels from consideration based on a comparison between the 

20 brightness level of three colors with brightness levels for copper. 

14. A method according to claim 13 wherein a pixel is eliminated from consideration as an 
oxide when its color brightness values have a Mahalanobis distance greater than a given value 
from the mean values of the brightness values for copper. 

25 

15. A method according to claim 14 wherein the given value for the Mahalanobis distance 
is between 4 and 8. 

16. A method according to claim 14 wherein fee given value for the Mahalanobis distance 
30 is about 6. 
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17. A method according to any of claims 2-16 wherein the determination of the presence of 
an oxide is made based on a relationship between the brightness values of the image and 
brightness values characteristic of copper. 

18. A method according to any of claim 4, 5 or 12 and comprising: 
determining a color gamut characteristic of the oxide; and 

comparing the color values of a pixel to the determined gamut of values to determine if 
the pixel is an oxide. 

19. A method of multi-color image processing, comprising: 

generating a plurality of images of an object, said images being acquired at different 

wavelength ranges; 

determining gradient values of the intensity in an image; and 

analyzing the multi-color images to determine characteristics of the object, 

wherein regions of the image at or near high gradients are analyzed differently from 

other regions of the image. 

20. A method according to claim 19 wherein the regions at high gradients are excluded 
from analysis. 

21. A method according to claim 19 or claim 20 wherein regions of relatively lower 
gradients are analyzed to determine characteristics of the object. 

22. A method according to any of claims 19-21 wherein the object is a printed circuit 
board. 
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